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Abstract — It is known that e-noisy gates with 2 inputs 
are universal for arbitrary computation (i.e. can compute 
any function with bounded error), if all gates fail inde- 
pendently with probabiUty e and e < /52 = (3 - V7)/4 w 
8.856%. In this paper it is shown that this bound is tight 
for formulas, by proving that gates with 2 inputs, in which 
each gate fails with probabiUty at least /32 cannot be 
universal. Hence, there is a threshold on the tolerable 
noise for formulas with 2-input gates and it is /32. It is 
conjectured that the same threshold also holds for circuits. 

Index Terms — Computation with unreliable compo- 
nents, fault-tolerant computation, noise threshold 

I. Introduction 

During the last decades, computers have become 
faster and faster, mainly due to advances in hard- 
ware miniaturization. However, there are physical 
limits to the possible extent of this miniaturization, 
and the closer one gets to these limits, the less robust 
and more error-prone the components become [[3]|, 
flU. It is estimated that the time when processor 
architects face these limitations is within the next 
decade [4]. 

Gates, the smallest components of any processor, 
can fail in (at least) two ways. The first is that they 
do not work at all. The second is that they work 
most of the time correctly, and fail sometimes. This 
type of errors is called "soft errors" by hardware 
engineers. We deal with faults of the second type. 

In particular, we consider the computational 
model of noisy formulas. Formulas are a special 
kind of circuits in which each gate has exactly 
one output wire [ij. We ask how much noise on the 
gates is tolerable, such that any function can still be 
computed by some formula with bounded-error. We 
will assume throughout that gates fail independently 
of each other. 

This question has been studied earlier. Already in 
1956 von Neumann discovered that reliable compu- 
tation is possible with noisy 3-majority gates if each 
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gate fails independently with probability less than 
0.0073 [[T2l . The first to prove an upper bound on 
the tolerable noise was Pippenger [[TT|. He proved 
that formulas with gates of fan-in at most k, where 
each gate fails independently with probability at 
least e > | — ^, are not sufficient for universal 
computation (i.e. not all functions can be computed 
with bounded error). Feder proved that this bound 
also applies to circuits [8]. Later, Feder's bound was 
improved to | — -K= by Evans and Schulman [6J. 
For formulas with gates of fan-in k and k odd, 
Evans and Schulman [|71 proved the tight bound 
/3fc = I — / ^fc_i N . Tight here means that if all gates 

fail independently with the same fixed probability 
e < Pk, then any function can be bounded-error 
computed, and if each gate fails with some proba- 
bility at least Pk (which does not need to be the same 
for all gates), universal computation is not possible. 
For k = 3 the threshold was first established by 
Hajek and Weller [9]. 

However, so far it has not been possible to 
establish thresholds for gates with even fan-in (or 
even prove their existence), as pointed out in [|7]|. In 
particular, the most basic case of fan-in 2, which 
is most commonly used, had been elusive. An 
intuitive argument why even fan-in is different is 
that for even fan-in threshold gates (and in particular 
majority gates) can never be "balanced", in the sense 
that the number of inputs on which they are 1 cannot 
be the same as the number of inputs on which they 
are 0. 

Evans and Pippenger Q made some progress in 
this direction. First, they show that all functions 
can be computed by formulas with noisy NAND- 
gates with fan-in 2, if each NAND-gate fails with 
probability exactly e, for any < e < [32 = ^-4 • 
Second, they show that with NAND-gates alone 
this bound cannot be improved (They make some 
additional assumptions which we discuss below). 
This left open the question of what the bound is 
if we allow all 16 gates with fan-in 2. We settle this 
question in this paper. 



Theorem 1: Assume A > 0. Functions that are 
computable with bias A by a formula in which all 
gates have fan-in at most 2 and fail independently 
with probability at least /32 = (3 — -\/7)/4, depend 
on at most a constant number of input bits. 

Together with the first mentioned result from Q 
this gives the exact threshold for formulas with gates 
of fan-in 2. It extends the second result from f5\ in 
the following ways: (1) We allow all gates of fan-in 
2, instead of only NAND-gates. (2) We prove that if 
the noise is exactly P2, then no universal bounded- 
error computation is possible. (3) In contrast to our 
result, the upper bound in [5] only applies to "soft" 
inputs. They show that gates with noise more than 
P2 cannot increase the bias. More precisely, if the 
inputs to the formula are noisy themselves and have 
bias at most A > 0, then the output of the formula 
cannot have larger bias than A. This left open the 
case where the input bits are not noisy and either 
or 1, which is the case we care about most. Our 
argument shows that even with perfect inputs fault- 
tolerant computation is not possible for noise at least 

To prove Theorem \T\ we introduce a new tech- 
nique, which is also applicable in the case of fan-in 
2. We expect that it can be extended to other fan-in 
cases. 

We conjecture that our bound also holds for 
circuits. 



A. Outline of the proof 

For any function / : {0, 1}" -^ {0, 1} we will 
choose an input bit Xi which / depends on, and 
fix all other bits such that / still depends on Xj . 
Assume that / is computed by a formula F with 
noisy gates that fail independently with probability 
at least ^2- Then, for each gate in the formula F 
with input wires A and B and output wire C we can 
define a = |P[A = | x^ = 0] + iP[A = | x^ = 1] 
and 6a = F[A = \ Xi = 0]-F[A = \ Xi = 1] 
and analogously for B and C. The variable a can 
be seen as the average probability of A being 0. We 
call 5a the bias of A with respect to the two input 
settings Xj = and Xj = 1. 

To prove our result one could attempt the follow- 
ing, which will turn out to not quite work (but we 
then show how to fix that): For an e-noisy gate with 
fan-in 2, input wires A, B and output wire C, we 
would like to show that if the noise e is at least 



the threshold P2 then for any 6 > there is some 
< 6' < 1 such that if 5 < max{\5a\, \5b\} then 



\6c\ < 6max{\6a\, \6b\} 



(1) 



This would mean that the bias goes down exponen- 
tially with the number of computation steps, until 
it reaches S. Further, it is easy to show that for 
any d > there is a function / such that any 
formula computing / has one input bit x,; on which 
/ depends and the number of computation steps on 
any path from Xj to the output bit is at least d. 
Hence, the bias cannot be bounded away from zero 
for all / and Xj. 

Unfortunately, ([T]) is not always true. Sometimes 
the bias can actually go upa We use a more so- 
phisticated approach, showing that the bias goes 
down "on average": We define a potential function 
q, which is positive and bounded on [0, 1]. Instead 
of showing ([T]) we show that for any 6 > there 
is some < 6' < 1 such that if 5 < raa,x{\5a\, \5b\} 
then 

\SMc) <0max{\6a\q{a),\Sb\q{b)}. (2) 

and if 5 > raa,x{\Sa\, \5b\} then ^ holds for 
9 = 1. Since q is bounded, this implies that for 
any arbitrarily small constant S > the bias of any 
formula becomes 0(6) after a constant number of 
computation steps. We can then proceed as above. 
We give the main proof in Section |IVl In Section 
Uni we prove Q, in the main Lemma [TJ Section |V] 
contains some remarks on our particular choice of 

II. Definitions 

A circuit is composed of gates. Each gate has a 
certain number of input wires, which is called the 
fan-in of the gate. The wires can take boolean values 
or 1. A gate computes an output bit as a boolean 
function of its input bits. A formula is a particular 
type of circuit in which the gates are connected in 
a tree, with the output gate at the root and the input 
bits at the leaves. In particular, this means that each 
gate has exactly one output wire. 

A (perfect) PARITY-gate with input bits Xi and 
X2 outputs if xi = X2 and 1 otherwise. A (perfect) 
OR-gate outputs if xi = X2 = and 1 otherwise. 

"An easy example is an OR-gate with noise e — 1/10, 5a = St = 
1/10 and a = 6 = 8/10, for which Sc = {aSi, + bSa){l - 2e) = 
0.128 > 1/10. 
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We call a gate e-noisy if it outputs the correct 
result with probability 1 — e and with probability 
e it outputs the opposite. We say that a formula 
F with noisy gates computes the function / with 
bias A > if for all x G /^^O), 1/ e /"^(l): 
P[F(x) = 0] > A + ¥[F{y) = O]0 If / can be 
computed with some bias A > we also say that 
/ is computable with bounded-error. 

A function / : {0, 1}" — *> {0, 1} depends on the 
i-th input bit Xi if there is some setting of the other 
bits, such that flipping Xi flips the function value. 
The number of bits that / depends on is denoted by 

d{f). 

In a formula, we define the depth of a wire A, 
denoted by depth(A), as the number of 2-input 
gates on a path from A to the output wire. Gates 
with fan-in 1 are not counted. 

For the definition of the quantities a and 5a for a 
wire A we refer to Section II-A[ 

III. Bias reduction for noisy gates 

We define the constant xq = 1/(2 - 4/?2) = (1 + 
\/7)/6 ^ 0.61. It will turn out later that an OR-gate 
with input wires A, B performs best when a ~ xq 
and b ~ xq. Further, we define the potential function 

q{x) = (f + 2v^)(x-|)^ 

+ (¥-f)(--l)'-^ + i (3) 

^ 19.79(s - 0.5)^ + 3.36(a; - 0.5)^ + 0.96. 
This is a biquadratic function in (x — 1/2). Fur- 

For our purposes it does not matter that with this definition / and 
/ are actually computed by the same F. 



ther, q is symmetric around 1/2 and convex. In 

[P2, 1 - /52] q is bounded between g.mj„ = g(l/2) = 
-77/2 + 73/32 > 0.9 and g„„, = qip^) = 
(247 + 8y7)/128 < 2.1, see Figure Iml 
For any e < 1/2 we define the function 

r]^{x) = (1 — 2e)x + e. 

If X is the probability that some variable is 0, then 
ri^{x) is the probability that it is after it has gone 
through an e-noisy channel. 

A. Technical Lemmas 

In the rest of this section we establish inequality 
([8]) in Lemma [H from which the proof of the main 
theorem will follow relatively straightforwardly. The 
proof of this inequality is quite technical and so at 
first reading the reader might just want to read the 
statement of Lemma [U and then move immediately 
to Section |IVl where we establish the main result. 
Inequality ([8]) can also be checked with the help of 
a computer (e.g. using Mathematica [IJ), but in the 
remainder of this section we will prove it rigorously. 

Proposition 1: For all a, 6 with (32 < a,h <1 — 
/?2 it holds that 



q{a)q{b) 
> 0. 



'l-2P2){aq{a)+bq{bMrj^,{ab)) 



(4) 



Proof: We write a = xq + Sa and b = xq + Sb- 
W.l.o.g. let \sb\ > \sa\ and choose — 1 < A; < 1 s.t. 
Sa = ksb- Then the Ihs of dH) can be written as 

11 



^ri{k)s 



i+2 



(5) 



The reason why ([5]) only starts with a quadratic term 
in Sb is our special choice of q, see Section IV-AI for 
more on this. The first coefficient is easily computed 



ro{k) = (3 - ¥) {e + 1) . 



This function attains its minimum value of 3 — 
3v/7/4 ^ 1.02 at A; = 0. Therefore, there is a k > 
s.t. for a,b E [xq — k,xo + k] the Ihs of (HI) is non- 
negative. We show that k = 0.02 is a solution. 

The absolute value of the other coefficients for 
— 1 < A; < 1 can be bounded by |ri(A;)| < 5, 
|r2(A;)| < 31, |r3(A;)| < 18, |r4(A;)| < 68, |r5(A;)| < 
326 and for all other |rj(A;)| < 5000. Therefore, if 
\sb\ < 1/50, ^ is at least 

si (1.02 - 5(0.02) - 31(0.02)2 - 18(0.02)^ - . . . ) 
> 0.90s^ > 0. 



This proves the case a;o — 1/50 < a,b < a;o+l/50. 
For all other |a — xqI > 1/50 or |6 — xo| > 1/50 the 
proposition follows from Fact \T\ with /i = 0. ■ 

We now state some bounds on polynomials. They 
are similar in spirit to dH), with the crucial difference 
that these bounds are not tight. This is convenient, 
because there are several techniques for finding 
global optima of multivariate polynomials up to ar- 
bitrary precision. See [lOJ for an overview. We have 
used the computer algebra program Mathematica 
|[I1. We used an accuracy of 10^^° and rounded 
the results in such a way that the bounds given are 
rigorous u 

Fact 1: For all a, b with (32 < a,h < 1 — (32 with 
\a-XQ\ > 1/50 and < fi < ^ := {l-/32-a){l- 
(32 - h) it holds that 

q{a)q{b) - (1 - 2(32){aq{a) + bq{b))q{rip^{ab + /i)) 
> 0.0003. 

(6) 
Proof: Notice that ji only appears in the term 
qirjp^iab + fJ,)). For < /i < ^ we notice that by 
convexity of q and linearity of t]^^ it follows that 
g(r/^2(a6 + /i)) < max{q{r]p^{ab)),q{T]p^{ab + ^))}. 
Thus, © is minimized for fi = or jj = ^. For 
/i = the Ihs of & is lower bounded by 0.0003 
and for /i = ^ by 0.01. ■ 

Fact 2: For all a, b, /i with (32 < b < I — (32, 



l/2<a< l-/?2 and |/i| <^:=2(l-/?2 
(32 - b) it holds that 



a)(l 



q{a)q(b) - ((2a - l)g(a) + (26 - l)q{b)){l - 2/?2) 
X 9(^/32 (a& + (1 - a)(l - 6) + /i)) 

> 0.45. 

Proof: For yU = ^ the term is lower bounded 
by 0.48 and for /i = — ^ by 0.55. Using convexity 
of q as above the fact follows. ■ 

Fact 3: For all a, 6, /i with (^2 < b < 1 — (^2, 
(32<a< 1/2 and |/i| < ^ := 2{a- P2){1 - p2 -b) 
it holds that 

q{a)q{b) - ((1 - 2a)q{a) + (26 - l)g(6))(l - 2/32) 
X q{rif3^{ab + (1 - a)(l - 6) + //)) 

> 0.48. 

Proof: For fi = $, the term is lower bounded by 
0.51 and for /i = — ^ by 0.48. The fact then follows 
by convexity of q as above. ■ 

Even more simple, one could bound the first derivatives and check 
all values of the polynomials on a small enough grid. 



Fact 4: Let a, b, /i with (32 < a,b < \ — (32 Then 

q{a) - {I - 2(32)bq{r]p^{ab - li)) > 0.22 

holds if (a) a < 1/2 and -(a - p2){l - P2 - b) < 
/i<0or(b)l/2 < aand-(l-/52-a)(l-^2-fe) < 
/i<0. 

Proof: For /i = (and all /^a < a < 1 - /?2) 
the term is lower bounded by 0.23. For both cases 
a < 1/2 , /i = -(a - /?2)(1 - (32-b) and 1/2 < a, 
/i = — (1 — /92 — a)(l — /?2 — 6) the term is lower 
bounded by 0.22. Using convexity of q as above the 
fact follows. ■ 

We can state our main Lemma. 

Lemma 1: Let /32 < e < 1/2. Assume an e-noisy 
OR-gate or PARITY-gate, with input wires A and 
B and output wire C. Let 



p2 < F[A = 0\x, = 0] < 1-/^2 
p2 < F[A = 0\x, = l] < 1-/^2, 



(7) 



and let the same be true for B. Define a,b,c and 
6a, Sb, Sc for A, B, C as in Section HI 

1) The following inequality holds for = 1: 

\6Mc) <0max{\6a\q{a),\6b\q{b)}. (8) 

2) For any S > there is a < ^ < 1 such that 
if li^al > S or \5b\ > 5, dS]) is still true for this 

e. 

Proof: We consider the OR-gate first. We have 

F[C = 0\xi = 0]= f], ((a + 6a/2) {b + 5^/2)) and 
P[C = I X, = 1] = r,,{{a-5al2){b-5b/2)), 
which implies 

4 = {a6b + b6a){l-2t) 
c = r]^ {ab + 6a6b/4:) . 

Increasing e decreases \5c\ as well as also g(c), since 
c gets closer to 1/2 and q decreases towards 1/2. 
Thus we may assume e = /?2- Further, we may 
assume \6a\q{a) > \db\q{b). Note that, for 5a = we 
then also have ^^ = and the Lemma holds trivially. 
In the remainder we therefore assume 5a 7^ 0. In 
fact, we will even assume 5a > 0: In case 5a < 
we can just formally replace every occurrence of 5a 
and 5b with —5a resp. —5b. Because of the absolute 
value signs, this will not change the validity of ^. 
So we have to prove 

(1 - 2e) \a5b + b5a\q {Ve (ab + 5a5b/4:)) (9) 
< e\5a\q{a). 



In the remainder, we will repeatedly use that a and 
b are bounded between P2 and 1 — /32 and that in 
this range, 0.9 < g„i„ < q{a) < q^ax < 2.1, 
without mentioning it each time. We distinguish the 
following cases: 

5h > 0: Since we assumed \6a\q{a) > \Sb\q{b), it 
is enough to prove ^ where we replace the first 
occurrence of 6b by 5aq{a)/q{b). Cancelling 5a and 
multiplying by q{b) we get 

9qia)qib) 

- (1 - 2/32) {aq{a) + bq{b)) q (r/^, {ab + 5ahl^)) 

> 0. 

(10) 
In case \a — Xq\ > 1/50 or \b — xq] > 1/50, note 
that 6aSb/4: < (1 - /32 - a){l - P2 - b). If we set 
/i = 5Jb/4. and 6 = 1, then by Fact [U the Ihs of ^ 
is greater than 0.0003. This implies the existence of 
a ^ < 1 for (flOl ) and settles both parts of the Lemma. 
We are left with the case |a — a;o| < 1/50 
and \b — Xq\ < 1/50. By (|7]) we can then bound 
<5a/2 <l-p2-a<l-P2-Xo + 1/50 < 0.33 and 
similarly 5^/2 < 0.33, i.e. {l-2p2)5a5b/4. < 0.1. We 
also note that in our case 0.37 < rij3^{ab) < 0.42. 
By convexity, mino.37<x<o.42 ^(2;) - q{.x + 0.1) = 
g(0.42) - g(0.52) > 0.02, and thus q{r]p^{ab) + 
0.1) < q'(?7/32(a^)) — 0.02. This last inequality, 
convexity of q and (1 — 2l32)5a5b/^ < 0.1 imply 
g(r/^,(a6) + (l-2/32)5A/4) < g(77^,(a6))-^(l- 
'2l32)5a5b/^. Noting that 7]p^{ab) + {l-2l32)5a5b/^ = 
ri[j^{ab + 5a5b/^) this becomes 

g(r/^,(a6 + 5A/4)) (11) 

<g(77^,(a6))-(l-2/?2)5A/20. 

In particular g(77/32(a6+(5a56/4)) < q{rip^{ab)). Plug- 
ging the Ihs of this into (flOl) and using Proposition 
[T] implies (flOl) for 9 = 1. This establishes part [T] of 
the Lemma for 6b > 0. 

Now part [2] of the Lemma. Let 5a > 5 or 
5b > 5. Consider first the case that 5b is not too 
small compared to 5a, say 5b > 5a/W0. Together 
with our assumption |(5a|g(a) > \5b\q{b) this implies 
{l-2P2)Sa5b/20 > (1 -2/^2)^72000. With ^ we 
then get q{riii^{ab + 5a5b/^)) + c < q{rip^{ab)) for 
c = (1 - 2/52)572000 > and putting this into © 
gives q{a)q{b) - {l-2(32){aq{a) + bq{b)){q{r]p2{ab+ 
5a5b/4:)) + c) > 0. This implies the existence of a 
6* < 1 for (flOl) and establishes part 2 of the Lemma 
when 5b > 5a/l00. 



If 5b is small, i.e. ^5 < 5^/100, then upper 
bounding the first occurrence of 5b by 5aq{a)/q{b) 
to get from ^ to (flOl ) was far from tight. A 
better bound is 5b < 5aq{a)/{l0q{b)), which derives 
from g(a)/(10g(6)) > qmin/{Wqmax) > 1/100. 
Analogously to the derivation of (fTOl ) we get 

0g(a)g(6) 

-(1 - 2/52) (ag(a)/10 + 6g(6)) q {'qp, {ab + 5aV4)) 

>0. 

(12) 
By dV]), a > (32- Thus, ag(a) > (32qmin and also 
g (?7/32 io,b + 5a5b/4:)) > qmin- Hence, the Ihs of (fT2l) 
is at least (1 - 2/52)/52g^m9/10 smaller than the Ihs 
of (flOl ). Since we already proved earlier that (flOl ) 
holds for 6* = 1 without the restriction 5b < 5a/100, 
we conclude that (fT2l) holds for some ^ < 1. This 
establishes part [21 of the Lemma for 5b < 5^/100. 

5b < 0: It is enough to prove ^ where we 
replace \a5b + b5a\ by (a) \b5a\ or (b) \a5b\. If in case 
(a) we cancel 5a and q{a) after the replacement, we 
see that a 6* < 1 must exist if 

q{a) - (1 - 2P2)bq{r]/,,{ab + 5„5,/4)) > x, (13) 

for some x > 0. Note that in case a < 1/2 we have 
-(a - /32)(1 - 132 -b) < 5a5b/4: < and in case 
1/2 < a we have -(1 - /^a - a){l - ^2 - b) < 
^a^b/^ < 0. The Lemma then follows from FactlH 

For case (b) we note that \a5b\ < a5aq{a)/q{b). 
Replacing \a5b + b5a\ in ^ by a5aq{a)/q{b) and 
rearranging terms we get exactly the same as (fT3l) . 
with a and b swapped. We proceed as in case (a). 

We now consider the PARITY-gate. First note, 
that if the two input wires of a noiseless PARITY 
gate are independently with probability a resp. 
P, then the output wire will be with probability 
a/3 + {1 — a){l — (3). Thus, in our case 



pfC = I Xi = 0] 
r^,{{a + 5a/2){b + 5b/2) 
+ {l-a-5a/2){l-b 



hl2)) 



and 



P[C = I Xi = 1] 
r],{{a-5a/2){b-5b/2) 
+ {l-a + 5a/2){l-b + 5b/2)) 



which implies 



r/e [ab + (1 - 
((2a -1)5, 



a){l-b) + 5a5b/2) 
-{2b-l)5a){l-2e) 



We need to prove 

\{2a-l)5i, + {2b-l)5a\{l~2t)x 

g(r7,(a6+(l-a)(l-6)+5A/2)) (14) 
<e\6a\q{a). 

As for the OR-gate we only need to consider e = (32 
and may assume 5a > w.l.o.g, because otherwise 
we can just change the signs of both 5a and 5^. Also, 
w.l.o.g. we assume \5a\q{a) > \5b\q{b). If 5a = 0, 
then also 5b = and the Lemma becomes trivial. 
So we assume 5a > 0. Further, we may assume 
b > 1/2 (and therefore {2b — l)5a > 0), because 
formally replacing a and 6 by 1 — a and 1 — b does 
not change (fT4l) . We condition on the sign of 2a— 1. 
First 2a — 1 > 0. It is enough to prove (fT4l) . 
where we replace the first occurrence of 5b by 
5aq{a)/q{b), since we assumed \5a\q{a) > \5b\q{b). 
Cancelling 5a and rearranging terms, the existence 
of a < ^ < 1 for (iMl) then follows from 



(26-l)g(6))(l-2/32) 
-a){l-b)+5a5b/2)) 



SetD= [log2(i(/)]-land5 



2(j„ 



Let ^ < 1 



q{a)q{b) - ((2a - l)g(a) - 
X q{rjp^{ab+{l 

>x>o. 



This inequality follows from Fact [2] by noting that 

l^bl < 2(1 -/32-b) and \5a\ < 2(1 - p2 ~ a). 

In case 2a — 1 < we can proceed similarly, 
where this time we replace the first occurrence of ^6 
by —5aq{a) / q{b) and bound \5a\ < 2(a — (32). The 
resulting inequality follows from Fact |3l ■ 

IV. Proof OF Theorem [H 

Proof: Let / be any function and let F be 
any formula with noisy gates that fail independently 
with probability at least (32- Let F compute / with 
bias A. We show that / depends on at most a 
constant number of bits, i.e. d{f) < c(A), for some 
function c(A). 

Before starting we note the following: Every e- 
noisy fan-in-2 gate can be constructed from an e- 
noisy PARITY- or an e-noisy OR-gate, perfect NOT- 
gates and constant inputs. Hence, we may assume 
that F is constructed from perfect NOT-gates and 
noisy PARITY-gates and OR-gates. 

Let Xi be an input bit on which / depends with 
the additional property that any input wire of F 
carrying xi has depth at least [log2 <i(/)l • Because 
all gates in F have fan-in at most 2, the existence of 
such Xi is guaranteed. Fix all other input bits such 
that the output of F changes when flipping Xi. 



be given by Lemma [T] for this 5. In case this results 
in 6* < 1 - 2(32, set 6* = 1 - 2(32- (The adjustment 
^ > 1 — 2/^2 is not really needed, but will later 
simplify the proof.) We will prove inductively that 
for any wire C at depth c? < D 

g(c)|5,|<max{|,e°-Va.}. (15) 

For (i = D (fTSl) holds trivially. Now take any 
wire C in F with depth rf < D. We distinguish 
what signal C carries. 

Firstly, C can be an input wire carrying Xj. Then 
necessarily i ^ j, because input wires carrying Xi 
have depth at least D + 1. Thus, 5c = and (fTSl) 
holds. 

Secondly, C can be the output of a noiseless 
NOT-gate, which has input wire B. Note that since 
we do not count NOT-gates in the depth of a wire, 
depth(C) = depth(B), c = 1 — b and 5c = —5b. 
Then, by symmetry of q around 1/2 we get ([T?] ) for 
C from the same statement for B. 

Thirdly, C can be the output of gate G, with G 
either an OR-gate or a PARITY-gate. Let the input 
wires to G be A and B. If one wire is a constant, say 
A, then gate G is essentially a (noisy) gate with fan- 
in 1. Hence, G always outputs either a (noisy) or 
1, or G is the noisy identity- or the noisy NOT-gate. 
In the first two cases 5c = 0. In the last two cases 
we can easily calculate that \b — 1/2|(1 — 2e) = |c — 
1/2| and \5c\ < (1 — 2(^2)\Sb\- Because q decreases 
monotonically towards 1/2 and we chose ^ > 1 — 
2/?2, dH holds. 

So we are left with the case where both inputs 
to G are non-constant. Since rf < D, both wires A 
and B are the output of some noisy gate, so the 
conditions (|7]) in Lemma \T\ are satisfied. We may 
assume \5b\q{b) < \5a\q{a) w.l.o.g. If \5a\q{a) < 
A/2, then by part [T] from Lemma [H also |(5c|g(c) < 
A/2 and ^ holds. If |(5„|g(a) > A/2, then \5a\ > 

^ = 5. Then (fTSl ) follows from part |2] of Lemma 
[IJand the inductive assumption. 

Let O be the output wire of F, which by as- 
sumption has bias A. Because q'(o)A < A/2 
is impossible (since g(o) > qmin > 1/2) 
we get from (flSl) : g(o)A < 9^qmax, and fur- 
ther A < e^'^^^'^^f^^-^q^ajqrmn), which implies 
iog2(Ag^^Wg^„.) ^ ^ ^ \og2 d{f). Slucc 6 dcpcuds 

only on A, d{f) is upper bounded by the function 



c(A) := 2 {Aqmin/qr^ 



,l/log2 



V. Discussion 

We have shown a tight threshold for the noise 
which is tolerable for computation by formulas with 
gates of fan-in at most 2. This is the first result for 
gates with an even number of wires. It should be 
possible to generalize it to other fan-in, although 
the proof is probably more tedious. 

The same bound probably also applies to circuits 
with gates of fan-in at most 2. 

A. Choice of potential function 

So far we have not given any idea of why we 
chose this particular potential function. In fact, 
this choice is not unique. The choice of q was 
determined as follows: (1) It is convenient to choose 
q symmetric around 1/2, so applying a NOT-gate 
to wire A does not change the value of \5a\qia). 
(2) It is natural to scale q such that q{xo) = 
1. (3) After these choices, we have to choose 
£(lix)\x=xo = |(-1 + v^). This ensures that © 
does not have a linear term in Sb and only starts 
with the quadratic term, i.e. "r_i(/i;) = 0". (4) We 
also need ■£pq{x)\x=xo > 16 — 4V^ ^ 5.42, because 
that makes ro{k) > for — 1 < A; < 1. The rest of 
the choices are not so binding. 

However, a quadratic function alone is not 
enough. For ^ to be at least one also has con- 
straints on higher derivatives of q. The expression 
in (|3]) for q is one of the "nicer" possible potential 
functions. One can also find a possible q, by divid- 
ing the interval [P2, '^ — ^2] into smaller intervals and 
define q as different quadratic functions in each of 
these intervals. 



[3] P. Bose. Designing reliable systems with unreliable compo- 
nents. IEEE Micro, 26(5):5-6, 2006. 
[4] B. Colwell. Computer Architecture Beyond Moore's Law. St. 

Petersburg, 8-12 June 2006. International Computer Science 

Symposium in Russia. 
[5] W. Evans and N. Pippenger. On the maximum tolerable noise 

for reliable computation by formulas. IEEE Trans. Inform. 

Theory, 44(3): 1299-1305, 1998. 
[6] W. Evans and L. Schulman. Signal propagation and noisy 

circuits. IEEE Trans. Inform. Theory, 45(7):2367-2373, 1999. 
[7] W. Evans and L. Schulman. On the maximum tolerable noise 

of k-input gates for reliable computation by formulas. IEEE 

Trans. Inform. Theory, 49(ll):3094-3098, 2003. 
[8] T. Feder. Reliable computation by networks in the presence of 

noise. IEEE Trans. Inform. Theory, 35(3):569-571, 1989. 
[9] B. Hajek and T. Weller. On the maximum tolerable noise for 

reliable computation by formulas. IEEE Trans. Inform. Theory, 

37(2):388-391, 1991. 
[10] P. Parrilo and B. Sturmfels. Minimizing polynomial functions. 

In S. Basu and L. Gonzalez- Vega, editors. Algorithmic and 

quantitative real algebraic geometry, volume 60, pages 83-100. 

American Mathematical Society, 2003. 
[11] N. Pippenger. Reliable computation by formulas in the presence 

of noise. IEEE Trans. Inform. Theory, 34(2): 194-197, 1988. 
[12] J. von Neumann. Probabilistic logics and the synthesis of 

reliable organisms from unreliable components. In C. E. 

Shannon and J. McCarthy, editors. Automata Studies, volume 3, 

pages 43-99. Princeton University Press, Princeton, 1956. 



VI. Acknowledgements 

I would like to thank Intel chip designers Bob 
Colwell and Shekhar Borkar for pointing out [l2l 
and flU . I am also grateful to Ronald de Wolf, Peter 
Harremoes and an anonymous referee for some 
comments and to Ben Reichardt for proof-reading 
and pointing out some errors. 



References 

[1] Available at http://www.wolfram.com/| 

[2] S. Borkar. Designing reliable systems from unreliable compo- 
nents: The challenges of transistor variability and degradation. 
IEEE Micro, 25(6): 10-16, 2005. 



